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TITLE OF THE INVENTION 

Method and apparatus for black/white level stretch with bin underflow and bin 
overflow 

BACKGROUND OF THE INVENTION 

The present invention relates to an apparatus for improving picture quality by 
varying grayscales which represent dark/bright portions of image signals, and a method 
thereof 



DESCRIPTION OF THE RELATED ART 
1 . Drawings of related art 
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<FIG. 1> Schematic of black/white level stretching 



(a) (b) 

<FIG. 2> Example of mapping on black/white level stretching, wherein (a) shows block 
level stretching and (b) shows white level stretching 

2.Construction of related art 
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An automatic gain control method has the construction of a black/white 
estimation unit, a black/white level stretching mapping calculation unit, and a mapping 
unit. 

3. Operation of related art 

The mean calculation unit estimates levels for representing black/white level. 

When the level for expressing dark portion of input image is high, the black 
level stretching mapping calculation unit uses the mapping smaller than g(k)=k with 
respect to the dark level, and when the level for expressing bright portion of the input 
image is low, the white level stretching mapping calculation unit uses the mapping 
greater than g[k]=k with respect to the bright level 

The mapping unit applies the constructed mapping with respect to the input 

image. 

SUMMARY OF THE INVENTION 
Contents of the paper (by order) 
1-1. Description of circuits 

Circuit diagram: to show with block diagram (including neighboring function blocks) 

Detailed circuit diagram: to show with detailed circuit diagram including the new 

function block(s), which is the key feature of the present invention. 

Waveforms or flowcharts: to include waveforms if possible. Flowchart is a must for the 

microcomputer. 

1-2. Apparatus-related invention 

Drawings: to show the overall structure of the invention with perspective view 
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Detailed drawings: to show the detailed parts of the invention with exploded perspective 
views and sectional views 

Drawings of operation: if necessary, to show each operation of the invention. 

2. Object: technical effect aimed by the present invention 

e.g.) The present invention is suggested to achieve , by performing 

3. Construction: to list constituents elements of the invention 

4. Operation: to describe in detail the interoperation among the respective elements 

5. Effect: to describe technical advantages that solve the problems of the conventional 
art, for example, in view of new function, economical efficiency, etc., with 
accompanying data or drawings showing the actual effects obtained when being applied 
to the existing product 

6. Please insert more pages when the description exceeds one page. 



Drawing of the invention 
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<FIG. 3> Black level/white level stretch using bin underflow bin overflow 
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<FIG. 4> Bin underflow for black level stretch, (a) input pdf, (b) bin underflow occurs, 
and (c) pdf after bin underflow 
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<FIG. 5> Bin overflow for white level stretch, (a) input pdf, (b) bin overflow occurs, 
and (c) pdf after bin overflow 



2. Object of the present invention 

The present invention aims to improve the picture quahty by varying the 
grayscales that express dark or bright portion of the image signals. 



3. Construction of the present invention 

The present invention employs the construction having a pdf estimation unit, a 
black level adaptive underflow threshold calculation unit or white level adaptive 
underflow threshold calculation unit, a bin underflow bin overflow (BUBO) unit, a cdf 
calculation unit, a cdf compensation unit and a mapping unit. 
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4, The operation of the present invention 

The pdf estimation unit estimates pdf from the input image. For example, the 
pdf estimation unit may obtain pdf of the input image by using the mathematical 
formula as follows: 

(Formula) pdflf(ij)] + = 1, for V(/,7) e I 

f(ij) : (i, j)th pixel value 

I: index set 

pdf[k]: probability that f(i, j) = k 

The black level adaptive underflow threshold calculation unit calculates a value 
so that the image data of low gray level can perform stretch operation with the 
calculated value (see FIG. 4). For example, a underflow threshold may be used as the 
following: 

(Example 1) The black level adaptive underflow threshold calculation unit 
automatically calculates a threshold, and with the output, the th_low, i.e., the range for 
stretching, is calculated as the following: 

(Formula) if {^pdf[k] > range_percent * M*N) 

then th_low = k 

k: gray level value[0 -> 255] 

(Example 2) If the threshold is externally controlled by a user control at the 
black level adaptive underflow threshold processing unit, 

th_low <= external user control, that is, the range for stretching is determined 
from the outside. 
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With the determination of range for stretching, the underflow threshold (th_u) is 
determined, for example, by the following formula: 
th_u[k] = th_u_low, for k<th_low 
th_u[k] = th_u_high, for k>=thJow, 
where 

th_u_low < th_u_high 

M*N: image gray level value * image pixel resolution 

range_percent: percent of stretching with respect to M*N 

th_low: random low gray level value for black stretch (X-axis of FIG. 4) 

th_u_low: tiireshold value to be applied to the gray level value lower than 

thjow (Y-axis of FIG. 4) 

th_u_high: threshold value to be applied to the gray level value equal to, or 

greater than thJow (Y-axis of FIG. 4). 

As th_u is aligned to thJow, the image data having gray level value lower than 
th_low can have the effect of black stretching. 

As shown in FIG. 5, the white level adaptive underflow threshold calculation 
unit calculates a value so that the image data of high gray level can perform stretching 
operation with the calculated value. For example, a underflow threshold may be used as 
follows: 

(Example 1) If the white level adaptive underflow threshold calculation unit 
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automatically calculates a threshold and outputs it, th_low, i.e., the range for stretching 
is calculated as the following: 

(Formula) if i^pdf[k]> range_percent * M*N) 

then thhigh = k 

k: gray level value [255 -> 0] 
(Example 2) If the threshold is externally controlled at the white level adaptive 
underflow threshold processing unit by external user control, 

th high <= external user control, i.e., the th_high (range for stretching) is 
determined from the outside. 

With the determination of th_high, i.e., the range for stretching, the underflow 
threshold(th_u) is determined as the following: 
(Formula) th_u[k] = th_u_high, for k<th_high 

th_u[k] = th_uJow, for k>=th_high, 

where 

th_u_low < th_u_high 

M*N: image gray level value * image pixel resolution 

Range_percent: percent of stretching with respect to M*N 

th_high: random high gray level value for white stretching (X-axis of FIG. 4) 

th_u_high: threshold value to be applied to gray level value greater than 

th_high (Y-axis of FIG. 4) 

th_u_low: threshold value to be applied to gray level value equal to, or lower 

than th_high (Y-axis of FIG. 4). 
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As a result, as the th_u is aligned to th_high, the image data having gray level 
value more than th_high can have the white stretch effect. 

The BUBO unit detects the bin underflow and the bin overflow by using the 
given underflow threshold and overflow threshold by, 

(Formula) if pdflk] < th_u[k], then bin underflow, 

if pdf[k] > th_o, then bin overflow 
and adjusts pdf accordingly. 
(Formula) pdf[k] = th_u[k], if bin underflow, 
pdf[k] = th_o, if bin overflow, 
pdf[k] = pdf[k], otherwise 
The cdf calculation unit obtains cdf through cumulative sum from the pdf 

(Formula) cdf[k]=^;?rf/(0 • 

The cdf compensation unit compensates for the influence that the BUBO unit 
gives to the cdf For example, the compensation can be made by, 
(Formula) cdf[k] = (cdflk] - cdfIN-l]/(N-l))+k 
or 

(Formula) cdflk] = (N-l)/cdflN-l] * cdflk]. 

The mapping unit varies pixel value of the input image using the cdf as the 
mapping function. 

(Formula) g(ij) = cdf[f(i, j)] 

5. Effect of the present invention 

The present invention can improve the picture quality without using external 
resources in contrast enhancement, by varying the grayscales which express dark 
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portion or the bright portion of the image signals. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a schematic of black/white level stretching, 

FIG. 2 shows an example of mapping used for the black/white level stretching, 
wherein (a) shows the block level stretching and (b) shows the white level stretching, 
respectively, 

FIG. 3 shows the black level/white level stretch using bin underflow bin 
overflow, 

FIG. 4 shows the bin underflow for black level stretch, wherein (a) shows the 
input pdf, (b) shows the bin underflow occurrence, and (c) shows the pdf after bin 
underflow, and 

FIG. 5 shows the bin overflow for white level stretch, wherein (a) shows the 
input pdf, (b) shows the bin overflow occurrence, and (c) shows the pdf after bin 
overflow. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Algorithm for image enhancement with bin-underflow and bin-overflow 
- Jae-Hwan Oh, Seung-Joon Yang, Young- Jun Park and Hyun Kang 

Algorithm for Image Enhancement with Bin-Underflow and Bin- 
Overflow 

Jae-Hwan Oh, Seung-Joon Yang, Young- Jun Park, Hyun Kang 
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Display Group, Digital Media R& D Center, Samsung Electronics Co,, Ltd. 
Abstract 

Despite the numerous studies that have been pursued heretofore, a contrast 
enhancement algorithm, i.e., one of the signal processing algorithms for image 
enhancement, was hard to apply to the motion picture field such as TVs, due to screen 
flickering and difficulty in realizing dynamic range of the adjustable contrast level. 

In this paper, we suggest an efficient algorithm using bin-underflow bin- 
overflow (BUBO), which enables smooth adjustment in contrast level and which does 
not causes any side-effect such as flickering. We also intend to suggest a black/white 
level stretch algorithm which achieves enhancement in grayscales of dark portion and 
bright portion of the image, together with an algorithm for adjusting brightness of the 
screen with a static dynamic range. 

I. INTRODUCTION 

The contrast enhancement algorithm has its goal on widening dynamic range of 
the grayscale level and enhancing the image contrast. As is frequently shown in 
underexposed or overexposed photographic images, inappropriate contrast may result in 
substantial degradation in image quality. The histogram equalization (HE) [l]-[2] is one 
of the algorithms that are generally used to improve image contrast. To increase the 
contrast, 'HE' causes values of the picture element (pixel) of the image to have uniform 
distribution and thus to use all the available area of the grayscale level. *HE' is 
especially efficient in the dark area having minute details. However, because the 
cumulative distribution function (cdf) generated in accordance with the histogram of the 
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pixels is directly applied as the mapping function, adjusting the contrast level is difficult, 
and image quality may even degrade if the image has excellent quality already. 

A convexoconcave function[3] algorithm, which obtains average of the 
probability density function (pdf) of the image, determines areas with respect to the 
grayscales and calculates transfer function in accordance with the pdf distribution in 
each area, may enhance the contrast even in the local area in accordance with the 
determined areas. However, if applied to the motion picture image instead of still 
images, flickering may occur due to the average which changes with the varying pdf. 
Accordingly, contrast may not be applied effectively, which means that additional 
algorithms are needed for the special patterns such as monotonic images. 

In the present paper, an effective algorithm using bin-underflow bin-overflow 
(BUBO) is suggested. With this algorithm, brightness mapping function can be 
calculated efficiently even when the histogram of the image is particularly focused to a 
certain brightness level of the image and also the flickering is minimized, so that the 
maximum contrast effect is guaranteed. Further, by using threshold of two concepts for 
use in the BUBO contrast enhancement algorithm, level in the black/white area can be 
stretched with adjustment of image brightness and without reduction in dynamic range 
of the brightness. 

Simulation of the present algorithm proved that flickering rarely occurs in the 
still image and also in the video sequence. Also, contrast was enhanced greatly, while 
the contrast level can be adjusted smoothly. Furthermore, brighter and clearer picture 
quality was obtained through the brightness control and the black/white level stretch. As 
the algorithm is realized by not only the software but also the hardware, performance 
becomes more effective, and construction becomes efficient especially in view of cost. 
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Contents of this paper are arranged in the following order. Chapter II describes 
existing algorithms for contrast enhancement and analyses the problems accompanying 
the existing algorithms. Chapter III describes the suggested contrast enhancement 
algorithm using the BUBO, the brightness control method using thresholds of two 
concepts for use in the suggested algorithm, and the black/white level stretch method. 
Chapter IV analyses performances obtained by the suggested methods through several 
tests, and finally, Chapter V concludes the description. 

II. Existing algorithms 

In this section, several existing algorithms for contrast enhancement of the 
image will be introduced with brief description of their advantages and disadvantages. 

A. Histogram Equalization (HE) 

Many methods have been suggested for the enhancement of image contrast. 
Particularly, due to excellent effect and simplicity, *HE (Histogram Equalization)' 
became a renowned one among the image contrast enhancement methods, with lots of 
applications [4]-[7]. The main object of the 'HE' is to give uniform distribution of 
image histogram and thus rearrange the distribution of brightness values. In other words, 
the 'HE' obtains histogram value or pdf through the counting of the brightness level 
from the input image and then obtains cdf from the obtained values. Using the cdf as 
obtained, the histogram of the given image is changed to uniform pattern, and thus the 
contrast of the image improves, FIG. 1 shows one example of the 'HE'. 
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<FIG. 1> One example of Histogram Equalization 

However, shortcoming of the 'HE' is that it is hard to adjust the degree of 
contrast enhancement. As soon as the image is given, pdf and cdf are obtained, and the 
pdf and cdf as obtained are used as the mapping for the contrast enhancement. However, 
with the image of peculiar characteristics or with the image degraded with noise, 
undesirable result may be caused. Further, the 'HE* does not guarantee static relative 
brightness. The brightness of the image, which is obtained through the 'HE', is not 
related with the brightness of the given image, and therefore, if applied to the video 
sequence, there is no boundary between the bright scene and dark scene. The 'HE' can 
be quite effective in the dark region having details. However, the image of superior 
quality may be degraded with the 'HE'. Accordingly, a rather complex algorithm is 
needed to overcome such shortcoming, which is quite difficult to realize, 

B. Convexoconcave Function 

The convexoconcave function obtains pdf and cdf using the histogram of the 
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input image, calculates mean brightness from the pdf and cdf as obtained, and fixes the 
means brightness of the image by fixing the outputs related to the mean brightness. 
Further, the histogram of the image is divided into plural regions based on the calculated 
mean brightness, cdf for each region is obtained, and transfer function is obtained in 
accordance with the density of the cdf That is, the convexoconcave function has a 
mechanism of increasing contrast of the overall image, in which the transfer function 
has a steep sloping degree in the brightness level region where the pixel distribution is 
particularly focused, while the transfer function has a rather smooth sloping degree in 
the region having sparse pixel distribution. FIG. 2 shows one example of transfer 
function, which is obtained through the above process. 
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<FIG. 2> One example of convexoconcave transfer function 

However, if applied in the motion picture image such as video sequence instead 
of still images, the convexoconcave function may have flickering due to pdf changes of 
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the image frame. Because pdf is calculated for every frame of the image, and convex- 
concave of the line of the transfer function is determined in accordance with the 
distribution density of the pdf, this means that the line of the transfer function easily 
changes with a slight change in the pdf even when there is no scene change in the image. 
Furthermore, a flickering, in which screen suddenly blacks out and then returns, may 
occur as the gain for determining the level of contrast changes. Accordingly, only the 
contrast gain is applied in the range that would not cause the perceivable flickering, and 
as a result, clear image quality is not guaranteed. 

III. Suggested algorithms 

In this section, three algorithms, that is, the contrast enhancement, brightness 
control and black/white level stretch using the BUBO, will be described and main 
characteristics thereof will be explained. 

A. Contrast Enhancement with Bin-Underflow and Bin-Overflow 

As mentioned above, the 'HE' sometimes degrades image quality due to 
mapping fiinctions calculated from the overly populated area where the pdf is 
abnormally collected. That is, when the pdf is excessively distributed in the dark region 
of the grayscale level, the cdf line abruptly rises from the dark area, forming an 
unnatural curve of the mapping fimction. 

The contrast enhancement algorithm using BUBO can overcome such 
shortcomings of the 'HE', through the use of two concepts of overflow threshold and 
underflow threshold. That is, when the pdf of the image is overly collected in certain 
grayscale level, the overflow threshold serves as the clipping for the pdf that exceeds 
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the overflow threshold so as to prevent subsequent abrupt increase of the cdf FIG. 3 
shows one example of how the overflow threshold is applied. 




Ml. 



(a) 



(b) 



(c) 



<FIG. 3> Bin overflow operation, (a) input pdf, (b) bin overflow occurrence, and (c) pdf 
after bin overflow 

If there is no pdf in image or if there is a grayscale level having the pdf lower 
than the underflow threshold, the underflow threshold is used as a replacement for the 
pdf as much as the underflow threshold, in compensation for the shortage of cdf 
increase. FIG. 4 shows this process using the underflow threshold. 





(a) (b) (c) 

<FIG. 4> Bin underflow operation, (a) input pdf, (b) bin underflow occurrence, and (c) 
cdf after bin underflow 

A contrast enhancement algorithm using the two concepts of overflow 
threshold and underflow threshold can be constructed as follows: 
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<FIG. 5> Contrast enhancement using Bin-underflow Bin-overflow 
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In FIG. 5, pdf is estimated first, by calculating the histogram of the input image. 
For example, the pdf of the input image can be obtained by using the following formula: 
<Formula 1> 

pdfIf(ij)]+=l,for V(/,y)e/ 
f(i j) : (i j)th pixel value 
I : index set 

P[k] : probability that f(i, j) = k 

Next, bin underflow and bin overflow are detected by using the underflow 
threshold and overflow threshold, respectively, and the pdf is adjusted by the following 
formula: 

<Formula 2> 

pdf[k] = tho, if bin overflow, 
pdf[k] = thu, if bin underflow, 
pdf[k] = pdf[k], otherwise 

Accordingly, when bin overflow occurs due to accumulation of the histogram, 
overflow threshold is substituted for the pdf of the grayscale level, and when the 
resultant value of the accumulation of the histogram does not reach the underflow 
threshold, the pdf of the corresponding grayscale level is substituted for the underflow 
threshold. By doing so, initial pdf of the input image is changed to a new pdf according 
to the BUBO algorithm. 

By using the pdf adjusted as described above, the cdf is obtained through the 
cumulative sum of pdf 

<Formula 3> 

cdflk]= f^pdflt] 

(-0 
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t: O-k 

Due to the influence of the overflow threshold and underflow threshold, the 
maximum cumulative sum of the obtained cdf may not reach, or exceed the pixel value 
of the input image. Accordingly, the influence of the BUBO algorithm over the cdf 
needs compensation. For example, compensation can be made by 

<Formula 4> 

cdflk] = (cdf[k] - cdf[N-l]*k/(N-l))+k 
or 

<Formula 5> 

cdflk] = (N-l)/cdfIN-l] * cdf[k] 

In the case of <Formula 4>, cdf curve is compensated by calculating a 
difference between the cdf curve of pdf accumulation and a straight line connecting the 
maximum cdf and origin point, and then adding the calculated difference to the original 
straight line. In the case of <Formula 5>, compensation effect can be obtained by 
normalizing the cdf curve into the range of grayscale. However, if applied to the 
hardware level, the <Formula 5> becomes complex due to increase in undecided 
denominator of the division, and therefore, cost increases. 

FIG. 6 shows the calculation of transfer function by compensating the cdf using 
the <Formula 4>. As shown in FIG. 6, the number of pfd being clipped by the overflow 
threshold is greater than the number of pdf being filled by the underflow threshold. If 
things are opposite, that is, if the number of pdf being filled by the underflow threshold 
is greater than the number of pdf being clipped by the overflow threshold, the maximum 
cdf becomes larger than the number of entire pixels of the input image. However, this is 
not a big problem as the cdf curve can be recovered to the normal scale range due to the 
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compensation process in which a difference between the cdf curve and the line 
connecting the maximum cdf and the origin point is obtained and added to the original 
straight line. 

£ — 




<FIG. 6> cdf compensation 

The cdf calculated as shown in FIG. 6 is normalized to grayscale level, and by 
using this with transfer function, the pixel value of the input image is varied as the 
following: 
<Formula 6> 

g(i,j) = cdflf(i,j)] 
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By using the thresholds of two concepts, the contrast enhancement algorithm 
using BUBO can properly deal with the image statistics, and adjust the contrast level in 
accordance with the setting of the thresholds. Further, by setting the underflow 
threshold and overflow threshold properly, another effect of performing 'HE', which is 
the most-generally used algorithm, can also be obtained. 

As described above, the BUBO algorithm improves the shortcoming of the 
'HE' of having inaccurate calculation of the transfer function due to abnormal increase 
of cdf by the pdf, and also maintains the advantage of the 'HE', i.e., the simplicity. 
Furthermore, due to its extendibility, which means that the threshold used in the BUBO 
can be applied to the brightness control and black/white level stretch algorithms which 
will be described in detail in later part of this paper, it can be quite cost-effective when 
applied to the hardware level. 

B. Brightness control with bin-underflow and bin-overflow 

In designing the algorithm for image processing, a need arises to increase or 
decrease the brightness of the image in accordance with the characteristics of the 
application to be used. And usually, the brightness is adjusted either by using 
addition/reduction of offset in accordance with the brightness of the image, or by adding 
auto gain control (AGC) circuit. In the former case, image saturation occurs in the 
direction of black level or white level due to the offset addition or reduction and thus 
causes loss of dynamic range of the grayscale level. In the latter 's case, complexity 
increases due to addition of circuit, and therefore, cost increases. 

The brightness control algorithm using the BUBO can be realized to the same 
simplicity and without a loss of dynamic range of the grayscale level, by simply 
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applying a sloping degree of the function to the overflow threshold and underflow 
threshold described above. In other words, by applying the negative slope as the 
underflow threshold, the dark level of the grayscale level can be replaced by a 
underflow threshold larger than the bright level, and therefore, the curve of the transfer 
function can increase while maintaining the dynamic range of the grayscale. FIG. 7 
illustrates how the brightness increases when the negative slope is applied as the 
underflow threshold. 
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(a) (b) (c) 

<FIG. 7> Bin underflow for brightness increase, (a) input pdf, (b) bin underflow occurs, 
and (c) pdf after bin underflow 

If a positive slope is applied as the underflow threshold, then the bright level of 
the grayscale is substituted by a underflow threshold larger than the dark level, and 
therefore, the curve of the transfer function decreases. FIG. 8 shows how the brightness 
decreases when the positive slope is applied as the underflow threshold. 





(a) (b) 

<FIG. 8> Bin underflow for brightness decrease, (a) input pdf, (b) bin underflow occurs, 
and (c) pdf after bin underflow 
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FIG, 9 shows the construction of brightness control algorithm using BUBO. 
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<FIG. 9> Brightness control using bin-underflow bin-overflow 



In FIG. 9, pdf is estimated from the input image first. Next, an average 
brightness is analyzed from the estimated result. If the average brightness is dark, a 
decrease fiinction outputted as the underflow threshold, and if the average brightness is 
bright, the increase function is outputted as the underflow threshold, adaptively. 
Alternatively, the underflow threshold may be outputted based on the setting value by 
the user control instead of analyzing the average brightness of the image. 

<Formula 7> 

th_u[k]=a*(k-k_0) + b, 

a < 0, for brightness < th_m 

a > 0, for brightness > th_m 

b: constant 

k_0 : constant 

Applying sloping degree to the overflow threshold can influence the pdf 
increase pattern of the grayscale level. For example, if the positive sloping degree is 
applied as the overflow threshold, the cdf increase in the dark area increases, while the 
cdf increase in the bright area decreases. In other words, contrast in dark area increases 
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compared to the bright area, and this becomes a critical factor that determines contrast 
level 

The brightness control using BUBO can be effectively applied to the brightness 
setting in accordance with the characteristics of the panel such as LCD (Liquid Crystal 
Display). 

C. Black and white level stretch with bin-underflow and bin-overflow 

Due to the nature of human eyes in perceiving things, black white levels play a 
crucial role in the improvement of image quality. Even the same image or motion 
picture can be perceived with various levels of clarity to the viewer's eyes, depending 
on the black white levels. Accordingly, many attempts have been made to realize the 
image of excellent clarity by applying additional black/white level stretch algorithm to 
the contrast enhancement algorithm, however, problems such increased complexity and 
costs also followed. 

The black/white level stretch algorithm using BUBO can be realized simply by 
setting independent overflow threshold and underflow threshold for the black range and 
white range of the grayscale level for stretching. That is, the underflow threshold of the 
black range is set to be low, and the value substituted by the underflow threshold 
becomes low, and therefore, the increase in cdf decreases. By performing the cdf 
compensation as the above, the level of the desired black range is stretched. In this case, 
if '0' is used as the underflow threshold of the black range for stretching, pdf of the 
input image can be used without any change, and if the overflow threshold is big 
enough, the effect of histogram equalization can be obtained in the same area. 
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(a) (b) (c) 

<FIG. 10> Bin underflow for black level stretch, (a) input pdf, (b) bin underflow occurs, 
and (c) pdf after bin underflow 

Referring to FIG. 1 1 , the underflow threshold of the white range for stretching 
is set to be low, and the value substituted by the underflow threshold becomes low, and 
therefore, the increase in cdf decreases. By performing the cdf compensation as the 
above, the level of the desired white range is stretched. In this case, if '0' is used as the 
underflow threshold of the white range for stretching, pdf of the input image can be 
used without any change, and if the overflow threshold is big enough, the effect of 
histogram equalization can be obtained in the same area. 




(a) (b) (c) 

<FIG. 1 1> Bin underflow for white level stretch, (a) input pdf, (b) bin overflow 
occurs, and (c) pdf after bin overflow 

The black/white level stretch algorithm with BUBO can be constructed as the 
following: 
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<FIG. 12> Black/white level stretch with bin-underflow bin-overflow 
In FIG. 12, pdf is estimated from the input image first. If the grayscale 
expressing the dark area of the given image is high, the underflow threshold, which is 
lower than the underflow threshold being applied to the other ranges, is outputted with 
respect to the grayscale range for stretching. For example, the underflow threshold can 
be used as the following: 
<Formula 8> 

th_u[k] = th_uJow, for k < th_low 
th_u[k] = th_u_high, for k >= thjow, 
where 

th_u_low < th_u_high 

A better black stretch effect can also be obtained by outputting an overflow 
threshold, which is lower than the overflow threshold being applied to the other ranges, 
with respect to the grayscale range for stretching. That is, when the BUBO algorithm is 
applied to the image such as letter box, if the black level occupying relatively large area 
of the image is converted to one brightness level, the same will be clipped by the 
overflow threshold and thus, it does not cause any problem. However, if the black level 
is converged over the large black range due to the presence of noise, increase pattern of 
cdf becomes uncontrollable. In this case, the brightness corresponding to the black of 
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the letter box can be stretched clearly without having to use additional algorithms, by 
setting the independent overflow threshold at a low value with respect to the black range 
for stretching. 

For the stretching of white level, when the grayscale expressing the bright 
portion of the given image is low, the underflow threshold, which is lower than the 
underflow threshold for applying to the other ranges, is outputted with respect to the 
grayscale range for stretching. For example, the underflow threshold can be used as the 
following formula: 

<Formula 9> 

th_u[k] = th_u_high, for k<th_high 
th_u[k] = th__u_low, for k>= th^high, 
where 

th_u_low < th_u_high 

In this case, a better white stretching effect can be obtained by outputting an 
overflow threshold, which is lower than the overflow threshold for applying to the other 
ranges, with respect to the grayscale range for stretching. 

That is, by applying black/white level stretch algorithm to the image properly, 
the dark area becomes darker and the bright area becomes brighter, and as a result, more 
vivid visual effect is obtained. 

IV. Tests and results 

Image tests have been conducted with respect to three algorithms, i.e., contrast 
enhancement algorithm, black/white level stretch algorithm and brightness control 
algorithm to evaluate the performance of the suggested algorithms, and in this section. 
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the tests and their results will be described. For the image test, the BUBO algorithm was 
realized in the hardware level, and more than 1000 still images of the image database 
were subject to the image tests. Additionally, high quality source such as DVD and 
various types of motion picture sources such as RF broadcast were also used as the part 
of the test, and in this paper, one result will be described as an example. 

The result of image test using BUBO algorithm was processed with respect to 
only the right half of the image so as to enable comparison easier, and a curve of the 
transfer function, which is generated by the BUBO algorithm, is shown. Additionally, 
the shape of pdf changed by the BUBO algorithm is illustrated with the pdf before the 
change to enable more convenient comparison. 

A block diagram realized in hardware level is also attached to this paper, to 
illustrate the image enhancement result of the BUBO. 
A. Contrast enhancement with bin-underflow and bin-overflow 

In compensating the cdf, the contrast enhancement using BUBO algorithm 
adopted the formula 4. FIG. 13 shows one example in which the BUBO algorithm is 
applied to one still image. 
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(a) original image 
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(b) histogram equalized image 



(c) contrast enhanced image with BUBO 

<FIG. 13> Contrast enhancement with BUBO 

FIG. 13(b) shows the result of histogram equalization with respect to the entire 
screen, which is compared to the case where the BUBO algorithm is used. As shown, 
the histogram equalization may even drop the image quality due to the mapping 
function calculated from the pdf when the pdf is excessively collected at a certain 
portion. More specifically, pdf is excessively populated in the dark area among the 
grayscale level, resulting in abrupt increase of the cdf curve in the dark area and 
subsequent deformation of the curve of the mapping function. In the area corresponding 
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to the intermediate level of the grayscale also shows the saturation of the cdf curve, 
again, due to the abnormal focusing of the pdf in this area. FIG. 13(c) shows the image 
which is enhanced by the use of BUBO. As shown, excessive pdf in the grayscale is 
clipped by the overflow threshold, and therefore, abnormal increase of cdf is controlled. 
Also, the pdf shortage in the bright area of the grayscale is substituted by the underflow 
threshold, and thus helps the constant increase of cdf curve. 

In short, with the contrast enhancement algorithm using BUBO, it can be said 
that only the increase/decrease pattern of pdf of the image is taken and applied to the 
mapping function. By doing so, excessive emphasis with respect to a certain grayscale 
level is controlled, and as a result, the effect of getting balanced contrast enhancement 
can be obtained. 

B. Black and white level stretch with bin-underflow and bin-overflow 

The black/white level stretching using the BUBO algorithm applies 
independent overflow threshold and udnerflow threshold to the black range for 
stretching so as to obtain the effect of contrast enhancement. Referring to FIG. 14, the 
black range is referred to by 32, and the white range is referred to by 230. Also, the 
underflow threshold is set to •O'. 
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<FIG. 14> Black/white level stretched image with BUBO 

Referring to FIG. 14, the overflow threshold, which is same as the underflow 
threshold of the other ranges, is given to the black range and white range. By doing so, 
two effects can be obtained. That is, a certain pdf is not filled with the underflow 
threshold, but instead, the pdf of the input image itself is used. Secondly, excessive 
focusing of pdf and subsequent increase of cdf can be prevented by the overflow 
threshold. The image test result shows that the level of the black and white ranges are 
stretched, and the black range of the tranfer function is lowered while the white range of 
the transfer function is raised. In short, with the contrast enhancement using the BUBO, 
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it may feel like the overall image becomes a little bit darker, however, it is easily 
noticeable that the image becomes clearer too. 

C. Brightness control with bin-underflow and bin-overflow 

The brightness control algorithm using BUBO algorithm is realized by applying 
a sloping degree to the underflow threshold in the grayscale area excluding the area for 
black/white level stretching. One thing to make sure is that there has to be a limitation 
so that the value by the sloping degree of the underflow threshold may not exceed the 
overflow threshold. By doing so, malfunction due to the inverse between the overflow 
threshold and the underflow threshold can be avoided. FIG. 15 shows one example in 
which a negative sloping degree is applied for the underflow threshold to increase the 
brightness. 
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<FIG. 15> Brightness increased image with BUBO 

As shown, by applying the function having negative sloping degree to the 
underflow threshold, the amount of pdf accumulated in the dark area increases, and the 
entire cdf curve is raised so that the transfer function curve becomes point-headed. In 
other words, the overall mapping function can be increased without reducing the 
dynamic range of the grayscale, and as a result, the brightness is increased. 

V. Conclusion 

We suggested algorithms that could enhance image contrast, adjust the 
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brightness in accordance with the application type or the panel characteristics, and 
stretch the black/white level, through the use of the bin-underflow bin-overflow 
(BUBO). 

In particular, as is proven through the tests in the hardware level, the contrast 
enhancement algorithm using the BUBO can control the flickering phenomenon, which 
is one of the abnormalities that occur due to abrupt change in pdf between the 
application in the still image and application in the motion picture such as video 
sequence, and contrast effect can be applied with higher efficiency. 

Furthermore, clearer image representation can also be obtained in the 
monotonic image such as letter-box without having to use additional algorithm such as 
pattern detection algorithm, by applying the black/white level stretch algorithm with 
BUBO. 

When applied to the monitor such as LCD, the brightness control algorithm 
using BUBO enables clear representation of the image without causing saturation in any 
area, and with maintaining the djmamic range of the grayscale. 

The BUBO algorithm realizes all the fiinctions of contrast enhancement, 
black/white level stretch and brightness control using the thresholds of two concepts, 
and therefore, it is quite simple compared to the effect it can provide. Accordingly, the 
hardware design in minimum extent can provide the maximum effect. 
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Attachment: Hardware design/realization of image enhancement algorithm with BUBO 
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WHAT IS CLAIMED IS: 

1. An image enhancement method and apparatus comprising a pdf estimation 
unit, a black level adaptive underflow threshold calculation unit or white level adaptive 
underflow threshold calculation unit, or both of said calculation units, a bin underflow 
bin overflow (BUBO) unit, a cdf calculation unit, a cdf compensation unit and a 
mapping unit. 



2. An image enhancement method and apparatus of claim 1, comprising a pdf 
estimation unit for estimating a pdf from an input image. 



3. An image enhancement method and apparatus of claim 1, comprising a black 
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level adaptive underflow threshold calculation unit to output a underflow threshold to 
change the grayscale expressing a dark area of a given image. 

4. An image enhancement method and apparatus of claim 3, wherein the black 
level adaptive underflow threshold calculation method and apparatus outputs underflow 
threshold using the following formula: 

(Formula) if (^/?^35^[/r]> range_percent * M * N) 
then th_high = k 

th_u[k] = th u low, for k< th low 
th_u[k] = th_u_high, for k>=thJow, 
where 

th_u_low < th_u_high 

5. An image enhancement method and apparatus of claim 1, comprising a white 
level adaptive underflow threshold calculation unit to output a underflow threshold to 
change the grayscale expressing the bright area of a given image. 

6. An image enhancement method and apparatus of claim 5, wherein the white 
level adaptive underflow threshold calculation unit outputs a underflow threshold by 
using the following formula: 

(Formula) if (^pdf[k]> range jercent * M * N) 
then th_high = k 

th_u[k] = th_u_high, for k<th_high 
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th_u[k] = th^^ujow, for k>=th_high, 
where 

thulow < th_u_high 

7. An image enhancement method and apparatus of claim 1, comprising a 
BUBO unit to detect a bin underflow and a bin overflow using a given underflow 
threshold and a given overflow threshold, and accordingly adjust pdf. 

8. An image enhancement method and apparatus of claim 7, wherein the BUBO 
unit detects the bin underflow and the bin overflow by using the underflow threshold 
and the overflow threshold with the following formula: 

(Formula) if pdf[k] < th_u[k], then bin underflow, 
if pdf[k] > th_o, then bin overflow. 

9. An image enhancement method and apparatus of claim 7, wherein the BUBO 
unit adjusts the pdf using the following formula: 

(Formula) pdf[k] = c[k], if bin underflow, 
pdf[k] = const_o, if bin overflow. 

10. An image enhancement method and apparatus of claim 7, wherein the 
BUBO unit adjusts the pdf using the following formula: 

(Formula) pdflk] = th_u[k], if bin underflow, 
pdf[k] = th_o, if bin overflow. 
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11. An image enhancement method and apparatus of claim 1, comprising a cdf 

calculation unit to obtain a cdf through the cumulative sum of pdf by, 

k 

(Formula) cdf[k] = X/^^/t^l- 

12. An image enhancement method and apparatus of claim 1, comprising a cdf 
compensation unit to compensate for the influence of the BUBO unit to the cdf. 

13. An image enhancement method and apparatus of claim 12, wherein the cdf 
compensation unit compensates for the influence of the BUBO unit to the cdf by using 
the following formula: 

(Formula) cdf[k] = (cdflk] - cdf[N-l]/(N-l))+k. 

14. An image enhancement method and apparatus of claim 12, wherein the cdf 
compensation unit compensates for the influence of the BUBO unit to the cdf by using 
the following formula: 

(Formula) cdflk] = (N-l)/cdflN-l] * cdf[k]. 

15. An image enhancement method and apparatus of claim 1, comprising a 
mapping unit to change the pixel value of an input image by using a mapping function. 

16. An image enhancement method and apparatus of claim 15, wherein the 
pixel value of the input image is changed by using the mapping function and the 
following formula: 

(Formula) g(i, j) = cdf[f(i, j)]. 
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17. An image enhancement method and apparatus, comprising a pdf estimation 
unit, a black level adaptive underflow threshold processing unit (possible to include in 
the BUBO unit) by an external user control, or a white level adaptive underflow 
threshold processing unit (possible to include to the BUBO unit) by an external user 
control, or both of said processing units (possible to include to the BUBO unit), a bin 
underflow bin overflow (BUBO) unit, a cdf calculation unit, a cdf compensation unit, 
and a mapping unit. 

18. An image enhancement method and apparatus of claim 17, same as recited 
in claims 2 to 16 (* Please draft independent claims of claim 17 based on the claims 2 to 
16). Please also divide the above independent claims into 'apparatus' claims and 
'method' claims. 
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